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(57) Abstract 



A digital image processing system including a microprocessor (34), random access memory (36), storage memory (38), in 
put means (44 and/or 46), display means (42), and suitable logic (40) to provide existing digital image processing operations in a 
conventional graphical user interface, such as a windows environment, which allows the user to implement image processing op- 
erations on a selected portion of a movie without using a primitive special programming language. 
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DESKTOP DIGITAL VIDEO PROCESSING SYSTEM 

Technical Field 

This invention relates generally to digital 
video image processing and, more particularly, to a 
5 system including an improved user interface for perform- 
ing digital video image processing operations in real 
time on a general purpose desktop computer. 

Digital image processing has been in use. for 
10 many years for applications ranging from satellite 
imagery to machine vision. A variety of digital image 
processing techniques, such as compression, warping, 
mathematical morphology, and other image combining 
operations have been implemented in the digital domain. 
15 These implementations, however, are often accomplished 
through the use of complex special purpose high speed 
digital hardware and/or machine specific software that 
operates, and must be programmed, at a primitive level. 

It is, therefore, an object of the present 
20 invention to create a digital image processing system 
which utilizes a general purpose desktop computer. 

It is another object of the present invention 
to provide a video digital image processing system 
including an interface which allows the user to employ 
25 complex image processing techniques to create and modify 
video movies in a conventional desktop user environment. 
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It is yet another object of the present 
invention to provide a digital video processing system 
which automatically records the processing operations 
selected to perform a particular video edit, so that 
5 variations in the editing process can be accomplished by 
recalling the original editing operations and reprocess- 
ing only those portions of the editing operations 
necessary to achieve a different desired result. 

It is yet another object of the present 
10 invention to provide a digital video processing system 
which automatically records the processing operation 
selected to perform a particular video edit, so that a 
movie can be edited in draft quality and, when complet- 
ed, completely reprocessed (on the system of the present 
15 invention or on a remote system) using higher resolution 
data. 

It is yet another object of the present 
invention to provide a video digital image processing 
system including an interface which allows for simple 
20 yet complete rotation, perspective and zooming of a 
selected clip. 

It is yet another object of the present 
invention to provide a video digital image processing 
system including an interface which allows for quick 
25 modification of a selected video clip to warp an image. 

It is yet another object of "the present 
invention to provide an interface which allows the user 
to create his/her own library of effects which may be 
recalled on command to operate on a selected clip. 
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It is yet another object of the present 
invention to provide a video digital image processing 
system including an interface which allows the user to 
view abstract sample images which display the results of 
5 a particular operation. 

It is yet another object of the present 
invention to provide a video digital image processing 
system which is integrated with conventional word 
processing programs so that scripts corresponding to 
10 existing or desired scenes in a movie can be linked with 
corresponding digital video image clips. 

It is yet another ob j ect of the present 
invention to provide a digital video image processing 
system including a display which organizes and exhibits 
15 each video clip in a two-dimensional array, providing a 
Storyboard Viaw of the clips being incorporated into a 
movie. 

It is yet another object of the present 
invention to provide a digital video image processing 
20 system having an interface having a display including 
one or more selected clips from a plurality of clips 
being edited in a frame-by-frame display. 

It is an object of the present invention to 
provide a digital video image processing system having 
25 an interface including a display which provides a view 
of a portion or all of the video movie being edited 
therein. 

It should be noted that the words "desktop" or 
"personal" computer as used herein are intended to refer 
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to any of the currently available general purpose 
single-user computers which may operate independently or 
network and may incorporate suitable software to perform 
word processing, graphics, database, and spreadsheet 
5 functions. 

The words "video" or "movie" as used herein 
are intended to refer to any electronic display of 
digital data sequences as images (and, optionally, 
sound). As used herein, a video or movie may include 
10 one or more "clips" each of which are subsets of the 
movie. Each clip is itself a movie comprising a se- 
quence of one or more frames of images (and, optionally, 
sound) • 

Disclosure Of Invention 

15 i n carrying out. the above and other objects, 

the digital image processing system of the present- 
invention includes a microprocessor, random access 
memory, storage memory, such- as magnetic disk, input 
means, display means, and suitable logic to provide 

20 existing digital image processing operations in a 
conventional graphical user interface which allows the 
user to implement image processing techniques without 
utilizing a primitive special programming language. 

The image processing system of the present 
25 invention may also include suitable logic for creating 
data flow graphs recording the image processing opera- 
tions, and associated parameters and inputs selected 
using the interface, thereby allowing for easy modifica- 
tion of a previously designed set of processing opera- 
30 tions and reprocessing of one or more selected video 
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movie clips through recollection, alteration, and 
reprocessing of the stored data flow graphs relating to 
the selected clips. 

The video image processing system of the 
5 present invention also includes an interface capable of 
displaying one or more movie view windows. One movie 
view displays some or all of the clips of a selected 
movie playing in real time. Another movie view is 
formatted as a two-dimensional array into which some or 

10 all of the clips of a selected movie may be arranged in 
a Storyboard View. A third movie view is formatted as 
one or more horizontal strips capable of showing each 
frame of a selected clip in a Time line view to provide 
more precise display of those clips for frame-accurate 

15 editing. Another movie view is formatted as a conven- 
tional word processor file editor, and allows the user 
to view some or all of the clips of a movie with the 
associated script in text form. 

These windows, known as the Player, 
20 Storyboard, Time, and Script Views respectively, togeth- 
er provide a complete composition and editing environ- 
ment which allow the user to organize and process movie 
clips into a desired end product. 

The Player View is in substantial part a 
25 frame-size window through which some or all of the clips 
of your movie can be. played. A Player View window 
includes standard controls to start and stop your movie, 
control the sound volume and make selections. 

The Storyboard View window provides a two- 
30 dimensional view of a selected movie including each of 
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the clips similar to the way a spreadsheet provides a 
two-dimensional view of statistical data. Each cell of 
the Storyboard array contains a movie clip. Each row of 
the array represents a scene of the movie. This non- 
5 linear organization of movie clips provides a powerful 
way to edit movies without resorting to the more de- 
tailed display of a frame-by-frame view. 

The Time View provides a precise frame-by- 
frame display of one or more clips of a movie for f rame- 

10 accurate editing. The Time View also contains one or 
more sound tracks associated with the displayed clips, 
for similar editing. This view also may contain a track 
displaying the process and inputs that created the clip. 
The Time View is particularly useful for specifying 

15 multiple input operations such as transition and compos- 
ite when frame accurate alignment of the input movies is 
required. This linear view of video and audio material 
is also useful in making detailed editing decisions, 
because it displays both process information and scene 

20 information so that the user can immediately see how 
processing has been applied within a scene. In the 
preferred embodiment, the output of any image operations 
are automatically pasted in the Time view. In contrast, 
in the other movie views, the user is allowed to preview 

25 the output of the selected operation, but the output is 
incorporated into the movie only upon command. 

The Script View window is a conventional word 
processor which allows the user to prepare, edit and 
view, the script associated with the movie. The text in 
30 the Script View window may be linked or cross-referenced 
with associated clips so that, by clicking on a particu- 
lar clip in the Player, Storyboard or Time Views, the 
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system will search for the point in the script associat- 
ed with the selected clip and enter the Script View at 
that point. Selected clips may be cut and pasted from 
the other views into the script, just as other graphic 
5 or pictorial information is inserted into word processor 
style sheets. When in Script view, the user may double 
click on any clip to play that clip. 

The present invention also preferably accom- 
plishes many of the image processing techniques on 
LO selected clips by progressively altering the frames of 
the designated clip on the basis of specified parameters 
selected only for key frames. 

The present invention also provides a toolbox 
of digital image processing techniques including video 
L5 editing, channel operations, filtering and 3-D trans- 
forms for movies which can be defined, combined, and 
previewed in a visual programming environment. 

These and other objects, features, and advan- 
tages of the present invention are readily apparent from 
20 the following detailed description of the best mode for 
carrying out the invention, taken in connection with the 
accompanying drawings. 

WT ^gf Descripti on of Drawings 

Figure 1 is a schematic of the system of the 

25 present invention; 

Figure 2 is a dataflow diagram for a represen- 
tative movie processed using the present invention; 
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Figure 3 shows a typical multiple window 
display of the present invention in which the "Windows" 

menu is pulled down; 

Figure 4 illustrates the Player View window; 
5 Figure 5 illustrates the Storyboard View 

window; 

Figure 6 illustrates the Time View window; 
Figure 7 illustrates the Script View window ; 
Figure 8 illustrates a dialogue window gener- 
10 ated during implementation of the Pan-Zoom-Rotate 
command; 

Figure 9 illustrates a dialogue window includ- 
ing a begin and end frame preview of a Pan-Zoom-Rotate 
operation on a selected clip; 
15 Figure 10 illustrates a processing window for 

the Pan-Zoom-Rotate command; 

Figure 11 illustrates a clip preview window; 
Figure 12 illustrates a save window generated 
during implementation of the Pan-Zoom-Rotate command; 
20 Figure 13 illustrates a window including an 

animated view of a selected stored Pan-Zoom-Rotate 
operation; 

Figure 14 illustrates another dialogue window 
for a Pan-Zoom-Rotate command; 
25 Figure 15 illustrates dialogue window for the 

Warp command; 

Figure 16 is a screen illustrating an imple- 
mentation of a three dimensional Storyboard; and 

Figure 17 is a screen illustrating an imple- 
30 mentation of an alternative embodiment of the Time View 
window. 
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Best Mode For Carrying Out The Invention 

Referring now to Figure 1, the video image 
processing system of the present invention generally 
indicated as 30 includes a conventional desktop computer 
5 32 including a microprocessor 34, random access memory 
36, storage memory 38, and suitable logic 40 to imple- 
ment the image processing operations in the visual 
programming environment as hereinafter described. The 
system also includes a display 42, and one or more input 

10 devices such as a conventional keyboard 44 and/or mouse 
46. While the image processing system of the present 
invention preferably utilizes an Apple Macintosh II 
series, having a Motorola 680X0 (68020, 68030, and 
68040) series microprocessor, at least five megabytes of 

15 RAM, at least 80 megabytes of disk memory, a convention- 
al keyboard with numeric keypad, and conventional mouse 
or roller ball, other commercially available general 
purpose desktop computer hardware with similar color 
graphics capabilities may also be utilized for this 

20 purpose. 

Logic suitable for providing the image opera- 
tions, file utilities, and the visual programming 
interface hereinafter described are preferably pro- 
grammed in a Unix language such as "C". Again, however, 
25 other similar general purpose programming languages may 
be utilized to implement the logic and interface de- 
scribed herein. 

Referring to Figure 2, the system of the 
present invention preferably employs a dataflow archi- 
30 tecture which enables the system to capture and repro- 
duce all the operations (or steps) in the creation of a 
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movie. At each step, the system must interact with the 
user via the interface described hereinafter to identify 
the one or more input movies, the key frame (preferably 
the first frame and last frame of a clip) , control 
5 parameters required for implementation of a selected 
operation. The system then implements the selected 
operation, generates an output movie, and, if desired, 
saves that output movie as a new clip. As a result of 
the multiple input nature of each process the dataflow 

10 is capturing more than just a "list" of operations that 
is to be performed on a clip. Rather, it is capturing 
all of the movie edits and all of the combinations of 
clips. The interrelationship between the steps in. the 
process is defined by the relationship of the inputs and 

15 outputs of each of the steps. Thus, all aspects of 
movie making are captured in a dataflow structure which 
defines the inputs, parameters and output (s) for each 
step. Since each input (clip) is a movie and each 
output is a movie, each step in the process is unrelated 

20 in Time to the other steps except as the output movies 
from any one particular step are required as input 
movies to any other particular step. 

It will be appreciated that a set of opera- 
tions and inputs could be defined and appear in the 

25 dataflow graph shown in Figure 2 as a single operation. 
For example, if the Warp, Pan-Zoom, and Superimpose 
operations shown at 236 were to be used with inputs 
other than Source Movie 1 and Source Movie 2, that 
combination of operations might be grouped* as a single 

30 operation having two inputs (in place of Source Movie 1 
and Source Movie 2) and one output. 
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lt will also be appreciated by those skilled 
in the art that the dataflow processing implemented by 
the system of the present invention is not limited 
simply to the video portion of a movie. There is no 
5 inherent data type limitation in the dataflow structure 
of the system of the present invention. As used herein, 
a movie may represent any sequence of dynamic media 
including video data, audio data, control data (e.g. key 
frame parameters as a function of Time) , MIDI music data 

10 or SMPTE Time code information. All of these different 
media are Time dependent, are part of the movie, and may 
be used as input in the dataflow process in the manner 
described herein. For example, control information, may 
be used as input to a process to change the audio 

15 portion of a clip over Time. 

It should be noted that, from the movie 
dataflow diagram, individual diagrams for each media 
type may be derived directly if so desired. Thus, it is 
possible to generate the dataflow graph of all parts 
20 that operated in some way on the video portion of a 
movie, or the audio portion of a movie, or the MIDI 
portion. 

Use of the dataflow architecture for the 
system of the present invention also prov^ues for easy 

25 processing of a movie. After a movie (comprising one or 
more smaller individual movies or clips) has been 
completed using the interactive graphical user interface 
of the present invention, the dataflow graph correspond- 
ing, to that interactive session of the type shown in 

30 Figure 2 may be automatically created by the system and 
can be saved by the system and/ or displayed to the user. 
If a change is desired, the user may identify the 
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particular operation, revise the parameters, or one or 
more of the clip inputs, for that operation, and re- 
execute that operation. Once the operation generates a 
revised output, this output can be automatically sup- 
5 plied wherever required as a new input and those opera- 
tions utilizing the new input can be similarly repro- 
cessed. This "trickle down" process continues until all 
operations whose input has changed have been repro- 
cessed. 

10 It will be appreciated by those skilled in the 

art that for any particular edit, only those operations 
whose input has changed must be re-executed to generate 
the new, final movie. By generating only the media that 
was affected by the particular editing change, the 

15 system is, therefore, very efficient in its use of 
computing resources. 

It will also be appreciated by those skilled 
in the art that a movie can be edited using compressed 
image data which may also be at a lower frame rate and, 

20 once completed, the dataflow graph defining the process 
can be used to reprocess the entire movie using higher 
resolution images as input. This reprocessing could 
occur using high resolution digital image data as input 
for the required clips. Alternatively, the assembly and 

25 edit process can be implemented utilizing the dataflow 
graph for a movie on a different, remote system using 
the original media as the input. 

The system of the present invention preferably 
30 utilizes the digital image formatting compression 
functions of QuickTime", a software package available 
from Apple Computer, Inc. MacStile*, a software package 
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available from Software Originals, Inc. is also prefera- 
bly utilized to create the dataflow graphs utilized by 
the system. 

Referring now to Figure 3, the display 42 
5 provides a graphical user interface including a menu bar 
50 containing the names of each of the program menus 52- 
64. As with conventional graphical user interfaces 
(GDI's), the commands available under each of the menus 
52-64 may be displayed by keystroke command, or by 

10 positioning the arrow 66 over the desired menu name and 
clicking to "pull down" the available commands. For 
example, by clicking on the Windows Menu 64, the various 
commands may be pulled down and invoked. Again, as with 
conventional pull down menu interfaces, the commands are 

15 invoked by holding the mouse button down and positioning 
the arrow 66 down the menu until the desired command is 
highlighted, then releasing the mouse button. A desired 
command may also be invoked by striking the key combina- 
tions listed in the pull-down menu opposite the command. 

20 Consistent with conventional GUI's, the user may move 
from an active window to another window by positioning 
the cursor to the other window and "clicking" on it. 
Alternatively, the user may position the cursor on an 
icon associated with the desired window or action and 

25 "click" on the icon. Again, as with conventional GUI's, 
the user may double click on a file to load the data in 
the file or, if the file is a program, run the program. 
For example, the user may position the cursor over the 
clip displayed in any of the view windows and double 

30 click to play that clip. 

The display 42 may also include one or more of 
the movie views 70-76, from which the user can view and 
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edit selected clips of a movie. It will be appreciated 
by those skilled in the art that each of the movie views 
70-76 provides a different perspective from which clips 
can be viewed, analyzed and modified. For example, the 
5 Player View 70 offers a viewing screen for playing or 
stopping an entire movie or selected clip therefrom. 

Referring to Figure 4, the Player View 70 
includes a movie controller 80 which provides quick 
access to the controls for the viewing screen 78. By 

10 clicking on the sound button 82 , the volume of the sound 
can be adjusted. By clicking on the play button 84, the 
movie can be started and stopped. By clicking on. the 
slider 86, the user can move to any frame in the movie 
or clip being displayed in the viewing screen 78. The 

15 play reverse 88 and play forward 90 buttons can be 
activated to play the clip in the reverse or forward 
direction respectively for so long as the mouse button 
is held down. As with conventional GUI's, the sizing 
button 92 can be activated to resize the Player View 70. 

20 Similarly, the Player View 70 can be quickly toggled 
between a selected small and large size by clicking on 
the square 94 in the upper right corner of the window, 
and the window can be closed by clicking on the quit 
button 96 in the upper left corner of the window. 

25 The Player View 70 also preferably includes a 

series of icons 98-102, each representing a movie view. 
For example, clicking on the Storyboard View icon 100 
will open the Storyboard View window 72. 



30 



The Player View 70 may also include other 
information such as the filename of the current movie, 
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the screen size, and the location of the current frame 
displays. 

Referring now to Figure 5, the Storyboard View 
72 includes a two dimensional Storyboard array 104 which 
5 provides a grid upon which the clips 106-110 of a movie 
are arranged. In the preferred embodiment , up to five 
rows, labelled Scenes, and six columns, labelled Clips, 
, may be displayed on a full-sized conventional screen. 
In addition, a conventional horizontal slider 112 and 

10 vertical slider 114 may be positioned to scroll and pan 
over the entire fifty scene x fifty clip grid. Each of 
the clips may be moved, viewed, and edited in .the 
Storyboard View by selecting a clip (clip 110 is select- 
ed in Figure 4 , as denoted by the double-dark border) 

15 and implementing any of the system commands, as further 
described below. It will be appreciated by those 
skilled in the art that the Storyboard View 72 provides 
a clip-by-clip perspective that allows for easy rear- 
rangement and processing of clips in a movie. The 

20 Storyboard View also makes efficient use of available 
screen space when working with a large number of clips. 

Storyboard View 72 is particularly useful when 
performing operations that require multiple clip input, 
such as the Arithmetic, Transition, Mix, Composite, and 

25 Merge commands found in the Combine Menu (described 
hereinafter) . As will be appreciated by those skilled 
in the art, in the case of multiple clip inputs, the 
Storyboard is acting as a video switcher, allowing the 
user to direct any particular set of clips to one of the 

30 multiple input operations. The power of this Storyboard 
architecture allows the user to first operate on clips 
with filters and segmentation tools, such as Slice 
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(described hereinafter), then easily use the output of 
those operations as input to combining operations, such 
as composite, with no need to explicitly save intermedi- 
ate result clxps beyond simply dragging those clips to 
5 a Storyboard. 

When the movie in a Storyboard View is played, 
it will be played in scene order then clip order. Thus, 
referring again to Figure 5, clip* 106 will be played 
first, then clip 108, then clip 110. 

10 Figure 16 illustrates an alternative, three 

dimensional Storyboard View which may be implemented in 
the system of the present invention. The Storyboard for 
a particular movie, such as "Art Master 1 ' may be opened 
in the manner described above. A clip 232 could then 

15 also be selected as described above. In this alterna- 
tive embodiment, a predefined command could then be 
activated which would open yet another Storyboard View- 
234 including each of the clips of another movie, which 
other movie corresponds to clip 232 in the "Art Master" 

20 storyboard. 

As will be appreciated by those skilled in the 
art, the alternative three dimensional Storyboard 
illustrated in Figure 16 accommodates an n-deep hierar- 
chy which links a particular clip from one Storyboard 

25 (for example, clip 232) to another Storyboard View (234) 
including each of the clips comprising clip 232. By 
clicking on one of the clips in Storyboard View 234 , the 
user could activate yet another Storyboard which simi- 
larly includes all of the clips which form the movie 

30 corresponding to the selected clip in Storyboard View 
234. This hierarchical structure could be augmented by 
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providing a command which provides the dataflow graph 
identifying the inputs and the operation required to 
create any selected clip. In this manner, the user can 
access the input data and specific parameters and 
5 operations at any level in the hierarchy of the evolu- 
tion of any selected clip or movie. 

Figure 6 illustrates another movie view, the 
Time View window 74. The Time View 74 includes a 
horizontal strip 112 displaying the clip or clips of the 

10 movie along with up to eight additional horizontal sound 
bands displaying the audio data associated with the 
clips shown in the framestrip 112. At full screen size, 
the Time View window 74 displays eight frame displays 
116, each corresponding to one or more frames in the 

15 selected clips. By clicking on the time scale indicator 
115, the ratio of the number of frames per frame display 
116 can be adjusted from 1:1 to 1:128. Thus, the Time 
View for a particularly long movie can be "condensed" so 
that each frame display 116 shows a representative one 

20 of a multiple number of frames in a sequence. Alterna- 
tively, the frame display ratio can be set to one to one 
so that every frame in the movie may be viewed and 
edited. 

As with the Storyboard View 72, conventional 
25 horizontal and vertical sliders 113 and 114 are provided 
to allow display of each of the horizontal frame dis- 
plays 120 and horizontal sound bands 118 regardless of 
the selected window size. 

As vrith the Storyboard View 72, once the Time 
30 View 74 is activated, a frame or group of frames may be 
selected for processing using the system commands 
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described below. It should be noted that by clicking on 
the frame ruler 124 the frame display 116 can be quickly 
toggled between its current ratio setting (shown in 
Figure 6 as 1:8) and 1:1. Thus, the single frame 
5 display can be quickly and easily accessed for frame 
accurate selections. 

It should be noted that, in addition to the 
Player Storyboard, and Time View icons 98-102, a number 
of other icon buttons 126-134 are provided in the ribbon 
10 controller 74 for quick positioning and easy control of 
the marked media. The clip-to-clip buttons 126, 127 
allow the user to position to the previous and next clip 
boundary (indicated by the clip markers 138) respect ive- 

15 One or more frames can be selected, as indi- 

cated by the selection bar. 136 by clicking and dragging 
along the horizontal frame display strip 116. Portions 
of the horizontal frame display strip 116 may also be 
selected by using standard Macintosh" selection methods. 

20 A group of frames can be selected and played, in the 
Player View 70, by activating the Play in Selection 
command under the movie menu, as hereinafter further 
described. Clip markers 138 identify the beginning and 
end points of each of the clips in the movie. Markers 

25 138 may be added or removed by clicking on a frame and 
executing the insert or remove clip marker command under 
the edit menu. 

Thus, it will be appreciated by those skilled 
in the art that the Time View window 74 provides for 
30 precise frame-by- frame and clip-by-clip identification 
and editing of a movie, with immediate access to the 
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altemate perspectives of the Player View 70 , Storyboard 
View 72 or Script View 76 by activating the appropriate 
icon or menu command. 

It should be noted that, though each of 
5 Figures 3-18 illustrate individual windows, these 
windows would appear on a display along with the menu 
bar 50 as shown in Figure 2, so that all of the avail- 
able commands are available through a series of clicks 
of the mouse 46. It should also be noted that standard 
10 Macintosh* selection and basic editing methods (such as 
Cut/ Copy/Paste) are utilized by the system of the 
present invention. Thus, movies may be freely moved 
between or within the Player, Storyboard and Time Views. 
Drag and Drop is supported for Preview windows , and 
15 within the Storyboard View to move movies easily while 
processing. 

Figure 17 illustrates an alternative Time View 
Window 240 which may be implemented in the system of the 
present invention. In this alternative Time View, the 
horizontal strip 112 displays a selected clip or clips 
of a movie in the same manner as described above in 
connection with Figure 6. In addition, one or more 
clips 242-246 corresponding to the input to the opera- 
tion that produced the selected clip at 112 may also be 
displayed, along with an identification of the opera- 
tion, at 248. In this manner, the user may view the 
preceding operation that resulted in the creation of the 
selected clip on a frame-by-frame basis to determine 
whether, for example, alteration of the input and/or 
parameters for that operation, and reprocessing, is 
desirable. It should be noted that, as with the hierar- 
chical structure of the three dimensional Storyboard 
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illustrated in Figure 16, the system of the present 
invention could be implemented to allow the user to 
click on one of the input clips 242-246 to obtain yet 
another Time View Window showing that input clip as the 
5 selected clip at 112, and further showing the input clip 
or clips and associated operation which yielded the 
selected clip. 

Referring to Figure 7, the Script View 76 
links selected frames or clips from the movie with a 

10 script by activating a commercially available word 
processing program, such as WordPerfect" or Microsoft 
Word* for the Macintosh*. The text of the script can be 
input or edited just as any document might be prepared 
in using the word processing program. Thus, the top 

15 portion of the Script View 76 includes the menu bar 140 
and associated programming guides such as the rule 142 
from the word processing .program. For those programs 
which allow importation of graphics into documents, a* 
clip 106 can be imported into the document. For those 

20 word processing programs that are Apple* Quicktime* 
aware, a clip can be played directly from the Script 
View by double clicking the mouse 46 on the image. 

The system 30 also cross-references those por- 
tions of the script which are marked (for example, Scene 

25 i, clip 1 at 144 with the corresponding clip), so that 
if 9 for example, the user was working in the storyboard 
View window 72 and activated the clip at Scene 1, Clip 
1 and then activated the Script View window 76, the 
window would open with the script positioned in the 

30 window at Scene 1, Clip 1. Conversely, if the Script 
View is active at, for example, Scene 1, Clip 2 and the 
Player View 70 is activated, the viewing screen 78 would 
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display Scene 1, Clip 2. It will be appreciated by 
those skilled in the art that this integration of the 
scripting of the movie with the video and audio por- 
tions, greatly aids in the efficient organization and 
5 assembly of the movie. 

The program menus and their associated com- 
mands are summarized below: 

File - All system documents are managed 
through the File Menu. These documents may include 
10 digital image files, audio files, or text (script) 
files. The digital image files may be compressed and 
are formatted in conventional QuickTime", PICT or PICS 
formats. Sound files are kept in AIFF format. 

The File Menu may include conventional file 
15 management commands such .as "New" for opening a new 
movie file, "Open" and "Open As 11 for opening existing 
files, "Close" for closing the currently active window, 
"Save" and "Save As" for saving the current version of 
a movie. The File Menu also preferably includes a 
20 "Print To Video" command which clears the computer 
display to provide a menu and icon-free environment (for 
example, a solid blue background) over which a selected 
clip or movie is displayed so that the user can output 
the information displayed on the screen directly to 
25 tape. The File Menu also includes a "Preferences" 
command which allows the user to set certain program 
defaults, and a "Quit" command which allows the user to 
exit the system. 



30 



Edit - The Edit Menu preferably includes 
commands which are used to move selected portions of 
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media between movies. Both sound and video media may be 
moved with these operations. Edit commands include 
"Undo" which cancels the effects of the last command 
selected, "Cut" which removes the media (sound, video or 
5 both) of the current selection from the current movie 
and places it in the clipboard, "Copy" which places a 
duplicate of the selected media into the clipboard, 
"Paste" which places media from the clipboard into a 
movie at the current location of the cursor, "Paste 

10 Replace" which performs the same operation as "Paste", 
except that the media is pasted over, and replaces, the 
clip located at the current location, and "Clear" which 
removes media from a movie without saving it to . the 
clipboard. It should be noted that, as used herein, the 

15 clipboard is a conventional editing clipboard provided 
by the Apple Macintosh System, or an analogous work area 
which temporarily holds data that is being cut, copied, 
or pasted during editing operations. 

The Edit Kenu also preferably includes "Select 
20 All" which selects all of the media in the current movie 
from the first to the last frame, "Select None" which 
turns off any existing selection, "Set Track Volume" 
which allows for the volume of the track to be set 
whenever an insertion point is set in one of the sound- 
25 tracks in the Time View, and "Insert/Remove Clip Marker" 
which inserts or deletes a marker at the selected 
position of a clip in the Time View. 

Movie - The Movie Menu contains commands which 
define a movie, control the playback of the movie, and 
30 provide other detailed information about the current 
movie. Particular commands that may be implemented in 
the Movie Menu include "Crop" which creates a new movie 
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from a selected portion of the input movie, "Resize" 
which makes a new movie of a specified new size from a 
selected portion of the current movie, and "Recompress" 
which compresses the selected media according to one or 
5 more conventional compression schemes. 

The Movie Menus also contains "Set Duration" 
which changes the overall length of the selection in the 
current movie, "Vary Speed" which changes the duration 
of each frame in the current selection according to a 
10 selected speed factor, thereby producing a new movie 
that runs either faster or slower than the original, and 
"Play In Selection" which determines whether a selected 
portion or all of the current movie plays whenever the 
play button in the movie controller is clicked. 

15 The Movie Menu also includes "Loop" which, if 

set, plays the movie repeatedly from beginning to end 
when the play button is clicked, "Loop Back And Forth" 
which, when activated, plays the current movie forward 
from the current frame to the end of the movie, then in 

20 reverse to the beginning of the movie and repeats the 
loop continuously whenever the play button is clicked, 
and "Get Info" which provides detailed information about 
the current movie. 

Combine - The Combine Menu includes commands 
25 which combine or overlay selected portions of a movie in 
various ways. These commands may include "Transition" 
which performs a selected one of various conventional 
selected transitions between two identified adjacent 
clips, "Blend" which mixes selected portions of two 
30 clips together, "Chroma Key" which allows the user to 
select a color band in a clip (within a specified 



WO 94/03897 



PCT/US93/07232 



-24- 

tolerance) , which selected color band will be rendered 
transparent and through which a background clip will be 
seen. Combine also includes "Composite" which overlays 
(on a pixel-by-pixel basis) a foreground clip on a 
5 background clip using a third clip (called an "alpha 
channel mask" or "matte") to provide the information 
about how the first and second clips should be mixed, 
and "Mix" which performs algebraic additions of two 
selected inputs. 

10 The Combine Menu also includes the 

"Arithmetic" command which performs standard addition, 
subtraction and multiplication operations between . two 
selected clips. These operations are performed on a 
frame-by-frame basis and on a pixel -by-pixel basis 

15 within each frame pair. 

The Combine Menu also includes the "Logical" 
command which combines movies using the logical and, or 
and exclusive or "XOr". This command is particularly 
useful for creating alpha channel masks from multiple 
20 black and white channel input movies. It can also be 
used on color movies for color modification and unusual 
image composites. 

The Combine Menu also includes a "Merge" 
command which combines three channels into a single 
25 color movie. The three channels may represent either 
the RGB model or the HSV model. 

The Combine Menu also includes the "Replace" 
command which allows for selective replacement of any 
one channel in a color movie. 
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Color - The Color Menu provides commands which 
operate independently on each of the color channels for 
each frame of the selected clip. Two color models are 
supported, the RGB model, containing Red, Green and Blue 
5 channels used by the Apple Macintosh* operating system 
and the HSV itodel containing Hue, Saturation and Value 
(or intensity) channels often used by artists. 

The Color Menu includes the "Extract Channel" 
command, which removes a specified channel from a color 
10 clip and stores it as an 8-bit movie, which may then be 
displayed and used as a black and white clip. 

The Color Menu also includes the "Balance" 
command, which provides time varying control over the 
color balance of a selected clip. 

!5 The Color Menu also preferably includes the 

"Cycle" command which adds a constant to each pixel 
value in a selected channel of the input movie. 

The Color Menu also preferably includes the 
"Edges" command which finds edges in a movie by locating 
20 changes in adjacent pixel values. These edges are 
assigned the color defined by the edge color buttons in 
the dialogue and are multiplied by the slider setting to 
control brightness. 

The Color Menu also preferably includes the 
25 "Negative" command, which extracts one or more selected 
channels from each frame of the clip. 

Two other commands which are preferably 
included on the Color Menu are "Pallet" and "Custom 
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Pallet". Pallet colorizes a black and white channel or 
remaps the colors in a color movie using a 256-color 
pallet. Because there are 256 allowable pixel values in 
a channel, ranging from 0 (black) to 255 (white), each 
5 can be assigned a specific color using a pallet. A 
variety of pallets are provided from which a beginning 
and end pallet may be selected. 

This process creates a color movie from a 
single channel. If you specify different pallets for 
10 begin and End Times, the system creates a new color 
pallet for each frame of the clip. These pallets will 
very smoothly from the beginning of the clip to the end, 
exhibiting a slow color transition when the clip is 
played. 

The Custom Pallet command remaps the colors in 
a clip using a 256-color pallet in the same manner as 
the pallet command. However, Custom Pallet allows you 
to create tha pallet interactively by specifying a 
single color for each end of the pallet. The remainder 
of the pallet is created for you by interpolation. 
Custom Pallet allows for two different custom pallets, 
for the beginning and the end of the clip respectively. 
Pallets are then created for the intervening frames by 
interpolation so that the colors in the final clip 
change slowly from the begin pallet to the end pallet. 

Filter - The Filter Menu provides access to a 
variety of commands which change the appearance of a 
movie, taking a single clip as input, operating on its 
video portion, and outputting a new, modified clip. 
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Commands accessed via the Filter Menu include 
"Pan Zoom" which changes the position of the video plane 
in two dimensions and to zoom up or away from a movie. 

The Filter Menu also includes the "PZR" or 
5 "Pan-Zoom-Rotate" command which may be used to change 
the position of the video plane in three dimensions ; In 
addition to the pan and zoom capabilities, PZR also 
rotates the plane of the image above any of the X, Y or 
Z axes. The PZR command will be discussed hereinafter 
10 in further detail. 

The Filter Menu also includes the "Warp" 
command which stretches the image in a selected clip as 
if they were on a flat rubber sheet. This command is 
also described hereinafter in further detail- 

15 The Filter Menu also preferably includes 

"Slice" which replaces a range of values in a channel 
with a specified constant. This command allows you to 
segment objects from an input movie by specifying the 
range of values they contain. As will be appreciated by 

20 those skilled in the art, the default values of zero 
outside range and two hundred fifty-five inside range of 
the slice values will create a binary mask of the 
selected range which may then be used as an alpha 
channel mask in other combine operations. This command 

25 is also useful for modifying the color information in a 
clip. 

Another command which is preferably included 
in the Filter Menu is "Threshold". Threshold clips a 
channel at a specified value. All pixels below that 
30 value are set to zero (black) while all pixels above it 
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are set to 255 (white). In the case of a color clip, 
each of the RGB color channels are operated on indepen- 
dently. The Threshold command is used to select objects 
of interest which are the brightest objects in a chan- 
nel. This command is a simpler version of the slice 
command. It .can also be used for modification of the 
color space in color movies, providing an effect similar 
to a two-level "posterize". The "Window" command is 
also preferably included in the Filter Menu. The Window 
command displays only a selected portion of the values 
in a channel, thereby highlighting some features and 
hiding others. The range of selected values are reas- 
signed to fill the entire range of 0-255. Thus,, any 
value above the upper setting in the range is set to 
255, and any value below the lower setting is set to 
zero. As a result, the selected range of_yalues becomes 
the only visible portion of the movie. This command is 
useful for adjusting the visual appearance of a movie 
that may have been recorded too light or too dark. 

Another command that is preferably included in 
the Filter Menu is "Scale". Scale changes the bright- 
ness and contrast of a clip by changing the values of 
the pixels directly. Each pixel in the clip is multi- 
plied by the scale factor. Thus, scale factors less 
than one dim the movie while those greater than one 
brighten it. Offset values may also be selected to 
similarly change the contrast of a clip. Offset values 
greater than zero (1 to 255) reduce the contrast of a 
movie while those less than zero (-1 to -255) increase 
the contrast. The combination of the scale and contrast 
controls provides a general mechanism for adjusting the 
display characteristic of a clip. The Scale command is 
also useful for modifying the values in a movie prior to 
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using it in the Arithmetic command with another movie. 
This feature allows you to control which movie will 
dominate when the arithmetic operation is performed. 
Scale is also useful when operating on a grey scale 
5 channels for creating alpha channel masks. Controlling 
the brightness of the grey scale channel controls the 
dominance of the foreground movie when compositing. 

The Filter Menu also preferably includes 
"Convolve" which provides a Time varying filter for 
selected clip. One of a variety of known filters, such 
as Sharpen, Smooth, Smooth More, Edge All, Edge Horizon- 
tal, Edge Vertical, Edge Diagonal/, Edge Diagonal\, 
Emboss, or Shadow, may be selected for application on a 
frame-by-frame basis to a selected clip. In addition, 
different beginning and ending blends of the filtered 
and unfiltered image may be selected. The filtering on 
intervening frames of the clip will be performed by 
creating the unique filter for each frame of the clip 
based upon the beginning and end filter blends speci- 
fied. 

"Custom" is also preferably included in the 
Filter Menu. Custom provides for a custom three-by- 
three convolution kernel in addition to the above 
specified convolved kernels which filter a selected clip 
on a frame-by-frame basis. As with Convolve, a begin- 
ning and end blend of the filtered image with the 
original image can be specified. If the beginning and 
end blends are different, filtering on each of the 
intervening frames will be performed by creating a 
unique filter for each frame based upon the beginning 
and end filters. In addition, Convolve allows for 
specification of a scale (brightness) and offset (con- 
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trast) factors for each of the beginning and end points. 
Again, when these parameters are different for the begin 
and end frames, they are varied for each of the inter- 
vening frames. 

5 Another command preferably located on the 

Filter Menu js "Shape". Shape performs mathematical 
morphology (such as erosion or dilation, or conventional 
combinations of these operations) on a selected clip 
using a preselected structuring element. 

10 The Filter Menu also preferably includes 

"Posterize" which controls the number of discrete levels 
in a channel. For a 24 -bit color movie, there are 256 
levels in each channel (0-255). For a 16-bit movie, 
there are typically 32 levels in each channel. 

15 Posterize reduces the number of discrete levels to 
between 1 and 16, creating a paint-by-number or poster 
effect as the number of colors or levels are reduced. 

Another command preferably found on the Filter 
Menu is "Mosaic" which controls the apparent pixel size 

20 of each of the pixels in a clip. By specifying the 
horizontal and vertical size of the pixels in any one 
frame of the movie, a lower resolution version of the 
input movie can be created. The larger pixels in the 
output movie are formed by averaging the color values of 

25 all the pixels in the input movie that fall within the 
defined dimensions of the new pixel. As with other 
commands, different beginning and ending pixel sizes can 
be specified, and the system will operate independently 
on each frame of the clip to produce a smoothly varying 

30 pixel size for the clip. 
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The "Plug Ins" command in also preferably 
included on the Filter Menu. Plug Ins provides a 
directory into which any conventional, commercially 
available image filtering operation, such as the Aldus 
5 Gallery of Effects* and other Adobe Photoshop" compatible 
effects may be inserted . The system may perform a 
filtering operation on each frame of the selected clip 
using any one of the effects selected from this user 
created library. 

10 The Filter Menu also preferably includes the 

"Motion Filter" and "Motion Shape" commands. Motion 
Filter and Motion Shape are temporal convolution .and 
mathematical morphology operations respectively which 
use information from both the preceding and succeeding 

15 frames when processing a frame by utilizing a selected 
three dimensional structuring element, corresponding to 
single dimension structuring elements for each of Time 
periods n-1, n, and n+1. 

window - Referring again to Figure 2, the 
20 Window Menu provides commands which allow the user to 
open any of the four movie windows. The "Show Player" 
command opens a window which displays the Player View. 

The "Show Story Board" command opens a window 
which displays the story board view. 

25 The "Show Time View" command opens a window 

which displays the Time View. 

The "Show Script" command opens a window which 
shows the Script View. 
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The Window Menu also preferably includes a 
"Player Size" which provides for double size, normal 
size, half size, and quarter size default window sizes 
for the Player View window. 

5 The Window Menu also displays a list of the 

current opened movie windows, indicating which of those 
windows is active. 

Figures 8-14, along with the following de- 
scription set forth in detail the operation and inter- 
10 face for the Pan-Zoom-Rotate command. 

Referring first to Figure 8, after a user has 
selected a particular clip 106 from, for example, the 
Storyboard View 72, that clip may be modified by imple- 
menting the Pan-Zoom-Rotate command as described above. 

15 Once the command is selected, the Pan-Zoom-Rotate 
dialogue window is displayed by the system. The Begin- 
Time (first frame) and End Time (last frame) displays 
152, 154 initially include cross hairs identifying the 
origin and the X and Y axes in space along with a four- 

20 quadrant perspective grids 156, 158 representing the 
orientation or size of the beginning and ending frames. 
Each of the four quadrants of the perspective grids 156 
and 158 are preferably different colored lines such as, 
for example, a green X first quadrant, a yellow X second 

25 quadrant, a red X third quadrant, and a blue X fourth 
quadrant. It should be noted % that the third (red) 
quadrant of the grids 156, 158 do not appear in Figure 
8 (or Figure 14) because red reproduced in black and 
white as black. By color coding the icons, the user can 

30 quickly appreciate the degree of rotation and orienta- 
tion of the frame in three-space. 
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Referring again to Figure 8, the first frame 
has been rotated about the X axis by selecting X in the 
Begin Time rotation box 160 and either typing in the 
angle of rotation (55 degrees) in a numerical box or 
5 clicking on the ball of the thumbwheel 162 and rotating 
the ball to the desired position on the wheel, for 
example, at about 163, and releasing the button on the 
mouse 46. The grid 156 in the Begin Time display 152 
rotates as the thumbwheel ball 162 is moved about the 
10 circle (or as the desired number of degrees of rotation 
is entered in the appropriate numerical box) . Likewise, 
the grid 156 expands or contracts in size as the zoom 
slider 164 is positioned. 

In the example shown in Figure 8, the zoom 

15 slider 164 is positioned to slightly reduce the frame to 
eight tenths of its original area. While the zoom 
slider 166 for the End Time frame is positioned at 
normal size. It should be noted that, this conventional 
slider may be positioned to simultaneously and identi- 

20 cally adjust the zoom values of the Begin Time and End 
Time frames to the same value by positioning the center 
slider 168. Positioning bars 170 and 172 may be acti- 
vated in a conventional manner to position the Begin 
Time frame (as illustrated by the four quadrant grid 

25 156) in the X and Y axes, respectively. The center of 
the frame in the example shown in the Figure 8 has been 
moved to the right (+X) and up (-Y) from the origin. 
Rotation of the four quadrant grid 158 represents • the 
end frame of the clip can be accomplished by manii lat- 

30 ing the rotation controls in the corresponding End Time 
rotation box 174 as well as by translating the frame 
relative to the origin using sliders 178 and 180. The 
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rotation order box 182 may be set with the desired order 
of axial rotation. 

Once the desired Begin Time and End Time sizes 
and positions are established, the user can view an 
5 animation of the Pan-Zoom-Rotate effect by clicking on 
the Animate box 184. The grid 156 in the Begin Time 
display 152 will then move from its Begin Time size and 
position to the End Time size and position, thereby 
dynamically displaying the defined Pan-Zoom-Rotate 
10 action in abstract form. 

Referring to Figure 9, if the defined action 
still appears desirable, the user may preview the clip 
by clicking on the Preview window 188. The system then 
previews the Begin Time and End Time appearance of the 
15 clip by generating the first frame image in the Begin 
Time, display window 152 and displaying the last frame 
image in the End Time display window 154. If the 
operation is not desired, the operation can be canceled 
by activating the cancel button 190. 

20 If the operation is desired, the OK button 192 

is activated, and the system displays a status window 
193, shown in Figure 10, which tracks the frame-by-frame 
processing of the clip through the defined action. In 
addition, the status window display 194 displays each 

25 frame as it is processed. 

As with all operations defined with Begin Time 
and. End Time parameters that are non- identical , the 
system interpolates the parameters for all of the 
intervening frames the clip so processes. In the 
30 preferred embodiment, this interpolation is linear and 
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continuous with the defined parameters being set for the 
first frame (Begin Time) and last frame (End Time) of a 
clip. However, the system could also be designed to 
allow for specific parameter programming of additional 
5 key frames, with linear interpolation of each of the 
intervening frames between each of the defined key 
frames. In addition to this alternative discontinuous 
linear interpolation, other forms of interpolation may 
be provided without departing from the spirit of the 
10 invention. 

It vill, thus, be appreciated by those skilled 
in the art that the system of the present invention 
provides key frame based dynamic filters by interpolat- 
ing the process parameters for the filtering operations 

15 on each of the intervening frames between the key frame, 
thereby creating powerful special effects. Pan-Zoom- 
Rotate, and other Filter commands, generally have 
parameters that can be set to change the way they 
operate on an image. Since movies have many frames of 

20 images, it would be powerful to be able to set the 
parameters on a filter and process each image < frame) 
individually. However, such precise control would be 
tedious and time consuming. By providing a limited 
number of key frames for each clip for which parameters 

25 must be established, and interpolating those parameters 
for intervening frames, dynamic filtering is achieved 
without the redium of frame-by- frame programming. This 
concept of interpolation is utilized in the system 
wherever a continuous parameter exists that can be 

3 0 interpol ated . 

Referring now to Figure 11, upon completion of 
the Pan-Zoom-Rotate process, a Pan-Zoom-Rotate preview 
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window 194 is displayed showing the first frame (at 
Begin Time) of the clip 106. By activating the controls 
on the controller bar 196 in a manner similar to the 
movie controller 80 on the Player View window 70, the 

5 processed clip 106 can be played. If desired, the clip 
can be saved as a part of the movie by executing the 
appropriate commands, such as, for example, by clicking 
on the clip 106 in the preview display window 194, 
dragging the clip to the Storyboard, and pasting it in 

10 the desired location on the Storyboard. 

Referring to Figures 9 and 12, any defined 
parameters can be saved for future use by hitting. the 
save button 197 in the Pan-Zoom-Rotate window 150. The 
save window 200 is then displayed, allowing the user to 
15 execute any one of the conventional file manipulation 
options. 

It will be appreciated by those skilled in the 
art that the save option allows for creation of a custom 
special effects library which can be recalled with a 

20 click of the mouse 46. As shown in Figures 13 and 14, 
by clicking the mouse 46 on the select button 202, a 
directory of predefined Pan-Zoom-Rotate parameters, 
including any defined by the user, may be accessed and 
utilized for any selected clip. A window of predefined 

25 Pan-Zoom-Rotate selections 204 is displayed. The user 
may select from amongst defined categories or particular 
transformations. When a selection is made, a four- 
color, four-quadrant grid 206 (the red quadrant repro- 
duced as black) provides an animated movie at 208 of the 

30 selected pan-*5oom-Rotate action. The user can either 
select from a different category or different specific 
Pan-Zoom-Rotate transformation, cancel the window 
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altogether by clicking on the cancel button at 207 or 
select the chosen transformation by clicking on OK at 
209. The predefined parameters are then loaded by the 
system in the Pan- Zoom-Rotate dialogue window 150. 
5 Referring to Figure 14, the predefined "Stretch & Slide" 
operation has been chosen. Note the Begin Time and End 
Time parameters are displayed for the selected action. 

Referring now to Figure 15, the implementation 
of the Warp command by, for example, selecting a partic- 

10 ular clip 106 from the Storyboard View window 72, 
results in the display of the warp window dialogue 210. 
The first frame of the selected clip is displayed in the 
Begin Time window 152 and the last frame of the selected 
clip is displayed in the End Time window 154. A grid 

15 211 may be superimposed on the Begin Time window 152 and 
the End Time window 154 by activating the grid button 
212 (which toggles between "grid off and "grid on". 
Varying grid sizes are also provided so that the control 
points can be placed directly over the area of the movie 

20 that you wish to warp. To create a custom warp, the 
user simply activates the Custom button, then clicks and 
drags any control point on the grids 211, 213 to the 
desired location. The portion of the frame under this 
control point will be stretched to this new location. 

25 as with all commands that have different Begin 

Time and End Time parameters, the position of each of 
the control points will be interpolated for each of the 
intervening frames in the clip between the Begin Time 
frame and the End Time frame to create a Time varying 

30 warp. As with Pan-Zoom-Rotate, the system also provides 
a set of defined warp effects which may be selected from 
the category box 214 and the effect box 216, or alterna- 



WO 94/03897 



PCT/US93/07232 



-38- 



tively by clicking on the directory button 218 which 
will prompt the system to generate a directory window 
(not shown) including a display of predefined warp 
effects. Once selected, the system utilizes the stored 

5 parameters for the Begin Time frame and the End Time 
frame and displays the first frame of the clip in the 
Begin Time window 152 and the last frame of the clip in 
the End Time window 154, each altered as prescribed by 
the selected warp effect. In addition, an animated icon 

10 220 displays the defined effect. 

As with the Pan-Zoom-Rotate command, custom 
defined effects can be saved, thereby allowing the user 
to create his/her own library for quick recall for 
future use. 

15 it will be appreciated by those skilled in the 

art that, although the warp effect only warps the image 
in two dimensions, three dimensional warps may be 
simulated by careful adjustment of the control points on 
the grids 211, 213. 

20 similar command windows are provided for each 

of the frame/clip editing commands supported by the 
system. It will be appreciated by those skilled in the 
art that, where useful, predefined effects can be 
provided and implemented for other commands. In the 

25 preferred embodiment, such predefined, and user defin- 
able, effects are provided in a manner similar to that 
described above in connection with the Pari-Zoom-Rotate 
and. warp commands for the Transition, Pallet and 
Convolve commands. It will be appreciated that similar 

30 predefined and user defined parameters can be implement- 
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ed for other commands utilizing the above described 
interfaces. 

The command windows for other commands also 
similarly provide an opportunity to preview the effect 
5 of a selected command on the first frame and last of a 
selected clip, as well as the use of animated icons to 
demonstrate predefined effects where appropriate. Also, 
each command is typically implemented for a selected 
clip by activating an OK button in the command window. 

10 It will be appreciated by those skilled in the 

art that the interface for any effect implemented by. the 
system can include any one or more of the features 
described and shown in connection with Figures 8-14. 
The display o-f these various command windows to prompt 

15 the input of particular parameters for a selected 
command and a selected clip, and to preview the result 
for that clip provide a powerful and efficient movie 
editing tool, particularly when used in conjunction with 
the various movie views provided by the present inven- 

20 tion. 

While the best mode for carrying out the 
invention has been described in detail, those familiar 
with the art to which this invention relates will 
recognize various alternative designs and embodiments 
25 for practicing the invention as disclosed by the follow- 
ing claims. 
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What Is Claimed Is : 

1. A system for processing digital video 

movies including: 

a general purpose computer having 

a microprocessor, 

random access memory, 

storage memory, 

display means, and 

input means; 
first logic for implementing selected image 
processing operations on a selected portion of a movie 
in response to commands provided through the input 
means ; 

second logic for creating a dataflow graph 
representing the input movie, the image processing 
operation, and the output movie relating to the speci- 
fied operation, and storing the dataflow graph in 
storage memory. 
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® Save default movie with settings. 
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